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Convergence of Random Variables 


7.2.0 Convergence of Random Variables 

In some situations, we would like to see if a sequence of random variables X\, X 2 , X%, • • • 
"converges" to a random variable X. That is, we would like to see if X n gets closer and 
closer to X in some sense as 71 increases. For example, suppose that we are interested in 
knowing the value of a random variable X, but we are not able to observe X directly. Instead, 
you can do some measurements and come up with an estimate of X: call it X\ . You then 
perform more measurements and update your estimate of X and call it X<i- You continue this 
process to obtain X\, X 2 , X 3 , • • *. Your hope is that as 71 increases, your estimate gets 
better and better. That is, you hope that as 71 increases, X n gets closer and closer to X. In 
other words, you hope that X n converges to X. 

In fact, we have already seen the concept of convergence in Section 7.1.0 when we discussed 
limit theorems (the weak law of large numbers (WLLN) and the central limit theorem (CLT)). 
The WLLN states that the average of a large number of i.i.d. random variables converges in 
probability to the expected value. The CLT states that the normalized average of a sequence of 
i.i.d. random variables converges in distribution to a standard normal distribution. In this 
section, we will develop the theoretical background to study the convergence of a sequence of 
random variables in more detail. In particular, we will define different types of convergence. 
When we say that the sequence X n converges to X, it means that X n 's are getting "closer 
and closer" to X. Different types of convergence refer to different ways of defining what 
"closer" means. We also discuss how different types of convergence are related. 
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